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Abstract 

In the previous papers (Kuic et al. in Found Phys 42:319339, 2012; Kuic in arXiv:1506.02622, 2015), it was 
demonstrated that applying the principle of maximum information entropy by maximizing the conditional 
information entropy, subject to the constraint given by the Liouville equation averaged over the phase space, 
leads to a definition of the rate of entropy change for closed Hamiltonian systems without any additional 
assumptions. Here, we generalize this basic model and, with the introduction of the additional constraints 
which are equivalent to the hydrodynamic continuity equations, show that the results obtained are consistent 
with the known results from the nonequilibrium statistical mechanics and thermodynamics of irreversible 
processes. In this way, as a part of the approach developed in this paper, the rate of entropy change and 
entropy production density for the classical Hamiltonian fluid are obtained. The results obtained suggest the 
general applicability of the foundational principles of predictive statistical mechanics and their importance 
for the theory of irreversibility. 
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I. INTRODUCTION 


Here we continue the study started in [1, 2] of the application of predictive statistical mechanics 
to a problem of predicting the macroscopic time evolution of systems with Hamiltonian dynamics, 
in the case when the information about the microscopic dynamics is not complete. For this purpose, 
in [1] we developed the basic theoretical model for closed systems with time independent Hamil¬ 
tonian function, and it was generalized in [2] to include also closed systems with the Hamiltonian 
function that depends on time. Furthermore, in [1, 2] we also gave a brief introduction about the 
Shannon’s [3] concept of information entropy as the measure of uncertainty represented by the prob¬ 
ability distribution, and also on the principles of maximum information entropy and macroscopic 
reproducibility, which are the foundational principles of predictive statistical mechanics formulated 
by E. T. Jaynes [4-11]. Here we only mention that the principle of maximum information entropy 
represents the general criterion for the construction of probability distribution when the available 
information is not sufficient the unique determination of the distribution [4, 5]. Maximization of 
the information entropy subject to given constraints is an algorithm of the construction of the 
probability distribution (MaxEnt), such that only the information represented by these constraints 
is included in the probability distribution. If, by controling certain macroscopic quantities, the 
same macrosopic behavior is reproduced in the experiment, then, according to the principle of 
macroscopic reproducibility, the information about the values of those quantities is relevant for the 
prediction of that macroscopic phenomena. Sharp, definite predictions of macroscopic behavior 
are possible only because certain behavior is characteristic for each of the overwhelming majority 
of microstates compatible with data, and therefore, this is just the behavior that is reproduced 
experimentally under those constraints. That was confirmed also by the conclusions reached in the 
framework of MaxEnt formalism by Grandy [12-16]. 

In the interpretation given by Jaynes, irreversibility of physical processes reflects only our 
inability to follow the exact state of the system during the process, and it can be considered a 
consequence of the associated loss of information as to the state of the system [5]. In our previous 
papers [1, 2] we have demonstrated that such interpretation has a clear mathematical formulation 
in the concept of maximization of the conditional information entropy and its relation with the 
information entropy. In the basic model presented in [1, 2], this resulted in the definition of the 
entropy change and the rate of entropy change for a closed Hamiltonian system without additional 
assumptions. This paper is devoted to the generalization of the approach developed in [1, 2]. 
Through the comparison with the reduced description of nonequilibrium systems from reference 
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[17], we have concluded that for a such generalization, the data about the quantities relevant for the 
prediction on the specified time scales should be included in the basic theoretical model. According 
to [17], if we are interested in behavior of the system for time intervals that are not too small in the 
specified sense, the details of the initial state become unimportant and the number of parameters 
necessary for the description of the state of the system is reduced. Other methods that use reduced 
descriptions of nonequilibrium states along with the quantum or classical Liouville equations are 
also known from the literature [18-22]. We have selected the hydrodynamic time scale for the first 
step in the generalization of our approach, where for the description of a nonequilibrium system 
less detailed information about the microscopic dynamics is required in comparison to other time 
scales. 

Since the hydrodynamic continuity equations represent the basic element of a reduced descrip¬ 
tion on the hydrodynamic time scale, in Section II they are taken as the relevant information which, 
as additional constraints on the maximization of the conditional information entropy, should be 
included in our initial model. The equivalent form of these equations, suitable for the use in 
the variational calculation is also derived. In Section III conditions are verified under which this 
equivalence holds and the form of the hydrodynamic continuity equations does not depend on 
the missing information about the microscopic dynamics. Predictions that follow from the max¬ 
imization of the conditional information entropy, subject to the constraint given by the Liouville 
equation averaged over the available phase space, and additional constraints that are equivalent 
to the hydrodynamic continuity equations, are derived in Section IV. We show there that this 
generalized approach results in the microstate probability distribution which is identical in form 
to the relevant distribution for the classical fluid in local equilibrium known from the literature 
[17]. Furthermore, the expression for the rate of entropy change is obtained in accordance with 
the corresponding expression known from the thermodynamics of irreversible processes [23, 24]. 
This allows us to define the density of entropy production consistently with its basic postulates. In 
Section V corresponding results are also obtained for the classical fluid with external forcing. By 
further generalization of this approach in the further paper, open systems in contact with particle 
reservoirs will be discussed, and the transport coefficients for the classical fluid will be derived 
accordingly. 
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II. HYDRODYNAMIC CONTINUITY EQUATIONS 


Following ref. [17], for the time intervals longer than the time for the establishment of 
local equilibrium, local macroscopic quantities, such as the local particle-number density, the local 
momentum density and the local energy density, are sufficient to describe the nonequilibrium 
system. For the classical fluid of N identical particles, taken here as the basis for the analysis, the 
dynamical variables that correspond to these quantities are the particle-number density 


N 


n(r) = n(r; ri,..., Tat) = ^ 5(r - r* 


i=l 


momentum density 


and energy density 


N 


P(r) = P(r;ri,pi,.. .,rN,PN) = ^Pi(5(r - r* 


( 1 ) 


( 2 ) 


i=l 


h{r) = /i(r;ri,pi,...,rAr,pAr) 


N 


E 

i=l 


N 


ri - r.- 


5{r- Ti) 


(3) 


+ i y fd. 

2m 2 ^ 

i=i> jV* 

The classical fluid of N identical particles is described by the translationaly and rotationaly invari¬ 
ant Hamiltonian function: 


N 


H{x,p) = ^ 


2=1 


2 1 ^ 

^ + - y ^ 

2m ‘y ^ 


Ti - r.' 


i=i. jV* 


(4) 


where <f>(|rj — rj|) is the potential energy of interaction of the particle pair with indices i,j. The 
set of QN dynamical variables is denoted by {x,p) and it consists of the Cartesian components 
of N position vectors (ri,... ,r 7 v) and corresponding N momentum vectors (pi,... ,PAr). Time 
dependence of the variables {x,p) is determined by Hamilton’s equations 

dH . dH 


Xi n ■! Pi O’ 

upi 


1 < i < 3iV , (5) 

It is easy to show that the integrals of the dynamical variables (1), (2) and (3) taken over the 
entire volume of the system give the total particle number Y, the total momentum Y^tot and the 
Hamiltonian function H{x,p) given by (4), respectively: 

N= [ n{r-,ri,...,rN)d^r , (6) 


Ptot = 


yPi = j P(r;ri,pi,...,rAr,pAr)(i^r , 

2=1 

H{x,p) = j h(r;ri,pi,... ,rAr,PAr) . 


(7) 

( 8 ) 
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The total particle number N is fixed and the Hamiltonian function H{x,p) given by (4) is time 
independent. The same is true for the total momentum Ptot; given by (7), because the Hamiltonian 
function H{x,p), given by (4), is translationaly invariant. This can be expressed in terms of Poisson 
brackets: 

dM 

^ = = (9) 

/7P 

= {Ptoi,77} = 0. (10) 

Local values of the macroscopic quantities (n(r))t, (P(r))t, {h{r))t that describe the classical 
fluid of identical particles are obtained by averaging the dynamical variables n(r), P(r) i h{r) over 
the microstate probability density function f{x,p,t) at time t: 


(«(r))t = 

/ f{x,P,t)n{r;ri,..., 

yn) dT , 

(11) 


Jm 



(P(r))i = 

/ f{x,P,t)P{v]Yi,pi. 

, • •., Tat, pat) dr , 

(12) 


Jm 



{Kx))t = 

/ f{x,P,t)h{r]Vi,Tpi, 
Jm 

. . . ,rAr,PAr)dr , 

(13) 


where dT = dxi ... dx^ndpi ■ ■ ■ dpsN is the volume element of the 6A^-dimensional phase space T. 
Averages (11), (12) and (13) are given by the integrals over the set M C T which corresponds to 
all possible microstates. The set M is that part of the phase space T which is accessible to the 
system. By definition the set M is taken here to be invariant to Hamiltonian motion of points 
{x,p) in T, as determined by the equations of motion (5). The boundaries of the set M C T are 
determined by the conservation laws given by (9) and (10), along with other possible conservation 
laws for the Hamiltonian function (4), and by our prior information on the possible values of these 
conserved quantities. Thus, together this determines the sample space, given by the set M, on 
which the probability density function f{x,p,t) is defined. Properties of the set M will be further 
elaborated in Section HI. The microstate probability density function f(x,p,t) for the system of 
N identical particles is normalized in accordance with the definition of microstates in the phase 
space that follows in the classical limit of quantum statistical mechanics [17]. 

The local dynamical variables n(r), P(r) and /i(r) are the densities of the corresponding con¬ 
served quantities N, Ptot i H{x,p)- The equations of motion of these dynamical variables can 
therefore be written in the form of the local microscopic conservation laws [17], 

= {f^(r),77} =-V-J(r) , 

= {P„(r),i7} = -V-Jpjr) , 
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dh{r) 

dt 


{h{r),H} = -V-3h{r) . 


(14) 


where {,} denotes the Poisson brackets. The Cartesian components of the momentum density 
vector P(r) are denoted by PQ(r), a = 1,2,3. The dynamical variables J(r), Jp„(r) and J/i(r) 
are the flux densities of conserved quantities whose densities are n(r), Pai'r) i h{r). Equations 
(14) are standard expressions; explicit derivations of the flux densities are found in the literature 
[16, 17, 23, 25]. 

The average value of the time derivative of any dynamical variable A is equal to the time 
derivative of the average value {A)t = Af dV of the same variable; 


dt/t 


d{A)t 


dt 


(15) 


The derivation of (15) uses: the equation of motion for the dynamical variable A, 


dt 




( 16 ) 


the Liouville equation for the microstate probability density f{x,p,t), 


dt 


dt 


+ {f,H} = 0, 


(17) 


and the n-dimensional generalization of the divergence theorem [26], the application of which along 
with the vanishing of the contribution of the boundary of the invariant set M (the explanation is 
analogous to that given for (43)) gives the second line of (15). 

By averaging (14) over the microstate probability density f{x,p,t) and using (15) one obtains 
the following expressions: 

= ({n(r).if)), = -V-(J(r)), , 

= {{hir), H}), = - V ■ {J„(r)), . (18) 


Time derivatives in (18) are denoted as partial derivatives because the average values of the densities 
depend on the position vector r also. Equations (18) are the local macroscopic conservation laws, 
which serve the basis for derivation of the hydrodynamic equations [16, 17, 23, 25]. 
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An important step in the derivation of equality (15) for an arbitrary dynamical variable A, and 
then also in the derivation of (18), was the use of the Liouville equation (17). Furthermore, it can 
be shown directly that the equations 

£h(r)(^^ + {f,ff}'^dr = 0, (19) 

are equivalent to the local macroscopic conservation laws (18). By using the divergence theorem 
in expressions (19) along with the vanishing of the contribution of the boundary of the set M, in 
the way described in the derivation of (15), and then using the right hand side of (14), we obtain 
the equivalent expressions 

J^(^^h{r) + fV-3h{r)^dT = 0. ( 20 ) 

These expressions are the local macroscopic conservation laws (18). 

III. MACROSCOPIC REPRODUCIBILITY AND THE HYDRODYNAMIC TIME SCALE 

Let us assume now, that along with the Hamiltonian function H{x,p) given by (4), the total 
Hamiltonian function Htot{x,p,t) includes also an additional term Hni{x,p,t), about which we do 
not have any prior information, 

Htotix,p,t) = H{x,p) + Hniix,p,t) ■ (21) 

Let us assume now that some microstate probability density function f{x,p,t) really satisfies “the 
total” Liouville equation 

^ + {/, Htot} = ^ + {/, H} + {/, Hr,,} = 0 . (22) 

As an addition, let us assume that the invariant set M of all possible microstates in the phase space, 
is invariant also on the time evolution described by the total Hamiltonian function Htot{x,p, t). This 
situation can be imagined in a case where the set of dynamical variables exists that are constants 
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of motion for both Hamiltonian functions, H{x,p) and Htotix,p,t). If such an assumption is 
unrealistic, we can assume instead the much simpler possibility that the invariant set M is the 
entire phase space M = T. 

Under these three assumptions the following statements are true. If the equations 



f{n{r),Hni}dr 



/{P,(r),F„i}dr 


f{hir),Hni}dr 


= 0 , 
= 0 , 
= 0 , 


(23) 


J M 

are satisfied then the local macroscopic conservation laws are valid in the form which is identical 
to (18). 

If the equations 


{n{r),Hni} = 0 , 
{Pa{r),Hni} = 0 , 
{h{r),Hni} = 0 , 


(24) 


are satisfied then the local microscopic conservation laws are valid in the form which is identical 
to (14). The condition (24) is more restrictive for Hni{x,p,t) than (23); if the condition (24) is 
satisfied then also the condition (23) is satisfied. 

Previous statements can essentially be summarized in the following way. If “the total” Liou- 
ville equation (22) is valid, and if the condition (24) or condition (23) is satisfied, then the local 
macroscopic conservation laws are still valid in the same form (18), which is equivalent to equations 
(19). 

It is important also that (23) and (24) can not be used in predictions with the help of the 
maximum entropy principle, because we do not have prior information about the term Hni{x,p,t) 
of the total Hamiltonian function Htotix,p,t). It is also important to note the following: if some 
function f{x,p,t) satisfies the total Liouville equation (22) and equations (23), then this function 
also satisfies the equations (19). The logical converse is not valid. 

Equations (23) and (24) can be interpreted in the following way. Equations (24) are statements 
that the missing information about the microscopic dynamics is not relevant for the description of 
time evolution of the local dynamical variables n(r), T’o(r) and h{r). Equations (23) are statements 
that the missing information about microscopic dynamics is not relevant for the description of time 
evolution of the local macroscopic quantities (n(r))t, {Pa{r))t and {h{r))t. Both statements are 



in accordance with the assumption that the reduced description of nonequilibrium macroscopic 
systems is possible on the specified time scales, as was discussed in detail in the previous section. 
That assumption can be accepted as the consequence of the foundational principle of macroscopic 
reproducibility. 

Thus, condition (23) or (24) is verified under which equations (19) are equivalent in form to 
the macroscopic continuity equations. These are the conditions under which the missing informa¬ 
tion about the microscopic dynamics (i.e. missing information about the term Hni of the total 
Hamiltonian function Htot in (21)) is not important for the form of the macroscopic continuity 
equations (18). It is explained why these conditions are so important for the reduced description of 
the system. The macroscopic continuity equations allow a further derivation of the hydrodynamic 
equations; they are the basic elements of the reduced description of the macroscopic time evolution 
on the hydrodynamic time scale. As a consequence, under condition (23) or (24), missing informa¬ 
tion about the microscopic dynamics is not relevant for a reduced description of a nonequilibrium 
system at a hydrodynamic time scale. 


IV. MAXENT AND HYDRODYNAMIC IRREVERSIBLE TIME EVOLUTION 


In relation to the basic model developed in the previous papers [1, 2], the macroscopic conserva¬ 
tion laws (18) represent the relevant additional information that is foundational for the description 
of nonequilibrium system on the hydrodynamic time scale. In the basic model, the only constraints 
on the maximization of the conditional information entropy, 


SF^{ta,to) = - f f DFlogDdTdSo 
Jso{M) Jr 


ho JSo{M) Jm 


dD 

~dt 


FlogD dVdSodt + 5f^(to,to) 


were the normalization of the conditional probability density D = D{x,p,t\{xo,po)oj,to), 

‘^i{{xo,Po)Lo,to;t,D) = F [ Ddr-F = 0, 

Jm 


(25) 


(26) 


and the Liouville equation for Il(x,p,f|(xo,Po)tj)^o) averaged over the available phase space (i.e 
over the set M C T of all possible microstates which is invariant to the Hamiltonian motion), 

m 

t 
- 

dt 


V’2{{xo,Po)oj,to]t,D) = 

Jm 


dD ^ 

■w+T, 

2=1 


/dD dH 

dD dH\' 

\dxi dpi 

dpi dxi J 


F dT = 0. 


(27) 


The conditional probability density D{x,p, t|(xo,Po)ajTo) corresponds to the conditional probability 
that at time t the point corresponding to the state of the system is in the element dT around {x,p), 
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if at time to it is anywhere along the paths passing through the infinitesimal surface element dSo 
located at (xo,Po) on the surface So{M). A phase space path is uniquely determined by the solution 
of Hamilton’s equations (5). By definition, the surface S'o(M) is perpendicular to all paths in the 
set H(M) of all phase space paths in M. The correspondence between the points (xo,Po)t<j £ So{M) 
and paths u) G H(M) is one-to-one and the measure defined on the surface So{M) is utilized as 
the measure on the set H(M) of all phase space paths in M. The conditional probability density 
D{x,p,t\{xo,po)oj,to) is defined by 


D{x,p,t\{xo,Po)uj,to) = 


G{x,p,t-, {xo,po) to) 


(28) 


F{ixo,Po)cu,to) 

Here, G{x,p,t] (xo,Po)cj, ^o) is a joint probability density of two continuous multidimensional vari¬ 
ables, {x,p) in r and (xo,Po)a; in So{M). Path probability density F{{xo,po)i^,to) is given by the 
integral 


^((a:o,Po)a;,to) 


G{x,p,t; {xo,po)u,to)dr, 


Jr 

Similarly, the microstate probability density is given by 


(29) 


f{x,p,t)= G{x,p,t-,{xo,po)uj,to)dSo. (30) 

JSo{M) 

If the Hamilton’s equations are time dependent then phase space paths are time dependent objects 
also. Therefore, as explained in the previous paper [2], the interpretation given to the function 
D{x,p, t\{xo,po)u},tQ) is in the case of time dependent Hamilton’s equations taken by the conditional 
probability density B{x,p,t\xo,po,to) defined by 


B{x,p,t\xo,po,to) = 


F{x,p,f,xo,Po,to) 


(31) 


f{xo,Po,to) 

Here, T{x,p,t',xo,po,to) is the probability density function defined on the 4s-dimensional space 

r> X 

r X r. The conditional information entropy Sj ■'(t, to) is obtained by replacement of the sym¬ 
bols with corresponding meanings in (25) as explained in [2]: replace G{x,p,t; {xo,po)i^,to) with 
F{x,p,t;xo,po,to), F{{xo,po)Lo,to) with f{xo,po,to), D{x,p,t\{xo,Po)uj,to) with B{x,p,t\xo,po,to), 


M and So{M) with T, and dSo with dTo- With these replacements applied to (26) and (27) we 
obtain the normalization condition and the Liouville equation for B{x,p,t\{xo,Po)ui,to) averaged 
over the available phase space, respectively. Analogous replacements are then applied also in the 
rest of the paper. 

The generalization of our approach [1, 2] that will be exposed here includes both constraints 
(26) and (27). The only difference with respect to the basic model are the additional constraints 
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(19) written here in the form 





/M JSo(M) 


n(r) 


dD ^fdDdH dDdH 

_ + - 

1=1 


dxi dpi dpi dxi 


FdSodT = 0 , 



IM JSo{M) 

^h{r,t,D) = 


Pair) 


on 3Ar 

oD 

ar + S 

2=1 


f dD dH 

dD dH\ 

\dxi dpi 

dpi dxi J 


FdSodV = 0 , 


Hr) 


3N 


dD ^^/dDdH dDdH 


FdSodT = 0 


(32) 


mJSo(m) L ^ydxidpi dpidxi^ 

where the index a = 1, 2,3 denotes the Cartesian components of the vector P(r). In the variational 
problem the additional constraints (32) are introduced with the help of the corresponding additional 
Lagrange multipliers An(r,t), Xp^{r,t), A/i(r,t) and the appropriate functionals 

Cn[D,Xn\ = [ [ Xnir,t)(pnir,t,D)d^rdt , 

Jto J 

CpAPHpc,] = [ [ >^pHr,t)‘PP^ir,t,D)d^rdt , 

Jto J 

Ch[D,Xh] = f [ Xhir,t)iphir,t,D)d^rdt 

Jto J 


(33) 


where (/9„(r, t, D), (pp^{r,t, D) (a = 1,2,3) and (pfiir,t,D) are the constraints given by (32). Sim¬ 
ilarly, constraints (26) and (27) are introduced using the Lagrange multipliers Ai((xo,Po)i.j,^) 
and X 2 iixo,po)uj,to]t) and the functionals: 

r rta 


Ci[D,Xi]= / Xi{{xo,po)uj,to-,t)ipi{{xo,po)uj,to-,t,D) dtdSo, 

JSo{M) Jto 


(34) 


and 


C2[D,X2]= / X2{ixo,po)uj,to;t)(p2{ixo,po)uj,to;t,D) dtdSo- 

JSo(M) Jto 

It is suitable to form the following functional 

J[D] = to) - Sf^^ito, to) = r [ [ K{D, dtD)dTdSodt, 

Jto JSo{M) JM 


(35) 


(36) 
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with the function K{D,dtD) given by 

dD 

K{D,dtD) = -—F\ogD. (37) 

The functional J\D] in (36) is rendered here stationary with respect to variations subject to the 
constraints (26), (27) and (32). As explained in the previous papers [1, 2], the Euler equation for 
the constraint (27) is equal to zero, and we apply the most general multiplier rule for this type of 
problems taken from ref. [27] by introducing an additional constant Lagrange multiplier Aq for the 
function K, 

j[D,\o]= r [ 

Jto JSo{M) 

The functional /[D, Aq, Ai, A 2 , A^, Ap^, A/i] is formed from (33), (34), (35) and (38): 

I[D, Ao, Ai, A2, A„, Xp^,Xh] = J[D, Ao] - Ci[D, Ai] - C2[D, X2] 


IM 


XoK{D, dtD) dVdS^dt. 


(38) 


-Cn[D, Xn] - Y, Cp^ [D, ApJ - Ch[D, Xh]. 


(39) 


Q:=l 


The existence of Lagrange multipliers Aq 7 ^ 0, and Ai, A 2 , A^, Ap^ (a = 1, 2 , 3) and Xh not all equal 
to zero, such that the variation of /[D, Aq, Ai, A 2 , A^, Ap^, A/i] is stationary 51 = 0, represents a 
proof that it is possible to make J[D\ in (36) stationary subject to constraints (26), (27) and (32). 

For a function T)(x,p,t|(xo,Po)aj,^o) to maximize {ta,to) subject to the constraints (26), 
(27) and (32), it is necessary that it satisfies the Euler equation: 

3N r 


Aq 


IdK d / dK \ ^ 

\dD dt\d{dtD)) ^ 


d dK \ d f dK 
+ 


8 X 2 


-FXi+F^ + F 
ot 


[dxi \d{dxiD)J dpi \d{dp,D) 
dXn dXh ^ 8Xp 

. a=l / 


+FI (^Xn{n,H} + Xh{h,H} + Y^>^pAPa,H}^ dA = 0 . 


(40) 


The term multiplied by Aq in the Euler equation (40) is equal to zero, and from there it follows 
that 

3 

\ c 
~ dt 


dXo 


dt 


+ 


dXn dXh p dXpc^ \ 3 


Q:=l 


+ J (^Xn{n,H} + Xh{h,H} + Y^^pAPa,H}^ dA = Xi . 


(41) 
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In this variational problem, the function D{x,p,t\{xo,po)i^,to) that renders J[D] in (36) stationary 
subject to constraints (26), (27) and (32), is not required to take on prescribed values on a portion 
of the boundary of integration region M x {to, to) in (36) where t ^ to. Therefore, in addition 
to satisfying the Euler equation (40), it is also necessary that it satisfies the Euler boundary 
condition on the portion of the boundary of M x {to, to) where its values are not prescribed (ref. 
[27]). Accordingly, for all points on the portion of the boundary of M x {to,ta) where t = ta the 
Euler boundary condition gives: 


dK 


FX2 — FI + A/j/i + 


= -F 


a=l 

3 


t=ta 


log D + \ 2 + f i A^n + Xhh + Xp^Pa j d^r 

V a=l / lt=u 


= 0 . 


(42) 


Eurthermore, for all points on the portion of the boundary of M x (toTa) where time t is in the 
interval to < t < ta, the Euler boundary condition gives: 

/ 3 \ 


A2 + / I XnU + A/i/i + d^r 


a=l 


V • n 


= 0. 


(43) 


at boundary of M 


In (43), V • n is a scalar product of the velocity vector field v{x,p) of points in E (defined in [1, 2]) 
and the unit normal n of the boundary surface of invariant set M, taken at the surface. Equation 
(43) is satisfied naturally due to Hamiltonian motion, since the set M is invariant to Hamiltonian 
motion by definition, and therefore v • n = 0 for all points on the boundary surface of the invariant 
set M. 

From the normalization condition (26) and equation (42) we obtain the MaxEnt conditional 
probability density in the form: 


D{x,p,t\{xo,po)io,to) = ^exp 



lU + Xhh + Xp^Poi 
cx=l 


(44) 


where the Lagrange multiplier X 2 {{xo,Po)u),to',t) = X 2 {t) is related to the normalization factor Z{t) 
of the conditional probability density in the following way: 


X 2 {t) = log Z{t) = log 


dr exp 



XnU + Xhh + Xp^Pa 


a=l 


(45) 


In standard MaxEnt formalism the normalization factor Z{t) is called the partition function, and 
in this case, we call it the partition functional because Z{t) = Zt [A^, A/i, Ap^j = Zt- Furthermore, 
equation (45) clearly shows why we need to keep the constraint (27) in this generalized approach; 
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removing it would amount to putting the corresponding Lagrange multiplier A 2 = 0, and thus 
introducing the excessive condition that Zt = 1. 

From the MaxEnt conditional probability density (44) we obtain the microstate probability 
density: 


f{x,p,t) = ^exp 


f d^r (XnTi + Xhh + 

V a=l 


(46) 


Equation (46) is obtained with the help of (30), using (28), (44) and the normalization condition 
of the path probability density F{{xo,po)co,to). From (44) and (46) we notice immediately the 
following equality 


D{x,p,t\{xo,po)u;,to) = f{x,p,t) . 

Also, from (44) and (46) it follows that at time t the information entropy Sj{t) given by 

S{{t) = - [ /log/dF, 


and the conditional information entropy Sj {t, to) given by (25) are equal: 

S{{t) = SP^{t,to) = log Zt + [ d^r (xn{n)t + Xh{h)t + Ap„(P«)t 


(47) 


(48) 


(49) 


a:=l 


From (47), or (49), it follows that the initial phase space paths at time to and final microstates at 
time t are statistically independent, which as its logical consequence has a total loss of correlation. 
This result confirms the validity of the condition t — to t, where r represents the time required 
for the loss of correlation between the initial phase space paths and final microstates. The reasons 
for the introduction of this condition are discussed in our previous papers [1, 2] and in reference 
[17]. 

The microstate probability density f{x,p,t) given by (46) is identical in form to the relevant 
distribution for the classical fluid in local equilibrium known from the literature [17]. With the 
assumption of local equilibrium, by simple comparison of the two distributions we obtain the 
following identifications of the Lagrange multipliers: 

An(r,t) = -/3(r,t) ^^(r,t) - ^mu^(r,t) 

-^Pc(r,i) = -I3{r,t)ua{r,t) 

A/i(r,t) = /3{r,t) . 


(50) 


In the reference [17] it is shown that k~^/3{r,t)~^ = T(r, t) has the role of local temperature, 
/i(r, t) of the local chemical potential per particle, and that u(r, t) is the velocity of the hydrody¬ 
namic motion. Furthermore, the identifications of the Lagrange multipliers Xn{x,t), Xp^{r,t) and 
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Xh{r,t) given by (50) show why we need all of the constraints given by the system of equations 
(32). Removing any of the constraints (32) would amount to putting the corresponding Lagrange 
multipliers equal to zero, and this would place excessive restrictions on the values of the local 
thermodynamic parameters (3{r,t) and 

It is important also that the assumption of local equilibrium gives a more precise physical 
definition of the condition t — to ^ t; time r required for the total loss of correlation between the 
initial phase space paths and final microstates is brought into relation with time Tr required for 
the establishment of local equilibrium of the fluid with the relevant distribution given by (46) and 
(50). 

Time derivative of the expression (45) for log Zt, where Zt is the partition functional, gives 
d log Zt 1 dZt 


dt 


Zt dt 


a=l / 


(51) 


dt 

Time derivative of information entropy Sf{t) in (49) is obtained with the help of (51), the con 
straints (32) and equations (18) which are equivalent to these constraints. 


dSj{t) 


dt 


= / d'^r A, 


d{n)t 

dt 


+ 


d{h)t 

dt 




a=l 

3 


d{Pa)t 

dt 


d^r Xn{{n, H})t + Xh{{h, H})t + Xp^ ({P„, H})t 


a=l 

3 


f d^r I A„V • (J )t + A,,V • {Jh)t + ^ Ap„ V • (JpJ 

V a=l 


(52) 


From the last line of (52), we obtain that the time derivative of information entropy Sj{t) is equal 

dS^(f) r [ ^ 

= - d\ V-(A„(J)t) + V-(A/,(J,,)i) +J]V-(Ap„(JpJ, 

L a=l 


dt 


/ 


+ / d-^r 


V(A„) • (J + V(A,,) • {Jh)t + ^ V(ApJ • {Jpjt 


a=l 


(53) 


By averaging the equation (41) over the microstate probability density f{x,p,t) and using (45), 
(51) and (52), it is easily shown that the Lagrange multiplier Ai depends only on time and that it 
is equal to the time derivative of information entropy, 

dS{{t) 


Miixo,Po)uj,to;t) = Xi{t) = 


dt 


(54) 


Equation (54) confirms the interpretation given to the Lagrange multiplier Ai in the basic model 
from the previous papers [1, 2]. In the generalization of the approach, the introduction of addi¬ 
tional constraints (32), equivalent to the hydrodynamic continuity equations (18), has determined 
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precisely the rate of entropy change given by the Lagrange multiplier Ai; it is determined by (53). 
It will now be shown that the obtained rate of entropy change (53) is equal to the corresponding 
standard expression from the thermodynamics of irreversible processes. 

From the literature [16, 23], it is known that the current densities in the macroscopic conserva¬ 
tion laws (18) can be written in the following form; 

m{J{r))t = p{r,t)u{r,t) , 

{JPc, is{r))t = p{r,t)ua{r,t)up{r,t)+Tpa{r,t) , 

{Jh,a{r))t = p{r,t)e{r,t)ua{r,t) +Tcp{r,t)up{r,t) + Jq^ a{r,t) . (55) 

Here p{r, t) is the mass density. The fluid velocity u(r, t) is the previously introduced velocity 
of hydrodynamic motion. In the second and third equation, T(r, t) is the pressure tensor with 
the components r^Q,(r, t). With the help of Einstein summation convention for the indices a, (3 as 
introduced in the above equations, the pressure tensor is defined by the relation dFa = —dSpTpa, 
where dF^ is the Cartesian component of the force dF across an infinitesimal surface element dS. 
The pressure tensor is the negative of the stress tensor. In the third equation, p(r, t)e{r, t) is 
the energy density, where e(r, t) is the energy per unit mass. Heat current density is denoted by 
jQ(r,t). 

Densities of particle number, momentum and energy, which have previously been introduced in 
the macroscopic conservation laws (18), are now analogously to (55) written in the form 

m{n{r))t = p{r,t) , 

(P(r))t = p{r,t)u{r,t) , 

{h{r))t = p(r,t)e(r,t) . (56) 

The fluid velocity u(r, t) can be consistently defined by the relation 

(J(r))t = (n(r))tu(r,t) . (57) 

Using the identifications of Lagrange multipliers (50) and relations (55) for the current densities, 
from the last line of (52) we obtain 

^ { -/3 (a- - h™^) L V . ,,u 

+/3 [V • (peu) -k V • (T • u) -k V • Jq] - /3 [u^V • {puau) + UadpTpa]} ■ (58) 
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Here, Einstein summation convention is implied, and using it we can write 

V • (T • u) = UadpTiia + T/Sad/sUa, (59) 

Furthermore, it follows also that 


■WaV • (pUqu) 


V • p; 


(60) 


\ / 

Then, using (59) and (60), from (58) we obtain 

dsUt) /• ,3 r ^ 1 

= - (fr \• pu 
at J I m 


+f3 


V 


pe - ^pu^ ) u ) + TpadpUa + V • Jq 


(61) 


Following reference [23], the local thermodynamic internal energy density U{r,t) is obtained by 
removing the convective kinetic energy density from the total energy density: 

1 


U (r, t) = pe{r, t) - ^pu^{r, t). 


(62) 


Following [23], we also define the viscous pressure tensor 11 as the nonequilibrium part of the 
pressure tensor 


Tapi^C, t) = p(r, t)5ap + n(r, t)ap, (63) 

where p(r, t) is the local pressure which comes from the assumption that the equilibrium equation 
of state is valid locally. Then, using (62) and (63) in (61), it is easy to obtain 

= - j ■ (/3[/u) + V • (/3pu) - V • 

-f7V(/3) • u - V (/3p) • u + —pV ■ u 


+/5 [n^aS/^Wo + V • Jq]} . (64) 

From the Euler equation for entropy, 

S = PE + ppV - PpN, (65) 

by applying it locally, using local extensive parameters E, V and N, and then taking the quantities 
per unit volume, it follows that the local entropy density s{r,t) is equal to 

s(r, t) = P{r, t)U (r, t) + /3(r, t)p{r, t) - ^(r, t)p{r, t)n(r, t), (66) 
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where n{r,t) = (n(r))t = p{r,t)/m is the local particle-number density. From the Gibbs-Duhem 
relation 


Edl3 + Vd {(dp) - Nd {(dp) = 0, 


(67) 


also applied locally and then written correspondingly for the local densities 


Ud(d + d {(dp) — nd {(dp) = 0, 


( 68 ) 


it follows for the local time changes that 


„dfl , 8(/3p) „ 


(69) 


Also, from (68) applied in the infinitesimal local system comoving with the fluid, it follows that 
^d(d d {(dp) d{(dp) 


^ dt^ 


— n- 


dt dt 

By comparing (69) and (70) we see that 


+ [t/V(/3) + V {(dp) - nV {(dp)] • u = 0. 


(70) 


[UV{(d) + V {(dp) - nV {(dp)] • u = 0. 


(71) 


So, from (64), using (66) and (71), we obtain 

dS{{t) 


dt Jv ^ ^ ^ 


+ / d\ [V(/3) • Jg - mpadpu^] . (72) 

Jv 

It is also important to note that, from the Euler equation (66), using the Gibbs-Duhem relation 
(68), we obtain for the local densities 

ds = (ddU — (dpdn. (73) 

Relation (73) is in accordance with the approach developed by Gallen [28], where the entropy in 
a nonequilibrium system is defined locally, assuming the same dependence on the local extensive 
parameters as in equilibrium. Furthermore, the expression (72), when multiplied by the Boltzmann 
constant k, is consistent with the rate of entropy change for a single component classical fluid, 
that follows from the standard approach to nonequilibrium thermodynamics that assumes local 
equilibrium [23, 24]. By comparison with the references [23, 24], we recognize that the divergence 
integral in (72) is the sum of convective and diffusive entropy flows over the boundary surface of 
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the volume, and that the second integral in (72) is identical with the volume integral of the density 
of entropy production. 

To simplify the calculation and identification of the aforementioned quantities, we introduce 
the new variables that are related with the old phase space variables {x,p) by a canonical 

transformation which has the following form 

Tfc = r'fc , Pfc = Pfc + , (74) 

where u(r'^,t) represents the fluid velocity at a position r(,. It is easily checked that the Jacobian of 
this transformation is equal to unity. By applying the change of variables given by (74), expressions 
(1), (2) and (3) are transformed in the following way 

n(r) = n\r) 

P(r) = P'(r) + mu(r, t)n'(r) 

h{r) = /i'(r) + u(r,t) • P'(r) + ^mu^(r, f)n'(r) . (75) 

Since the Jacobian of the transformation (74) is equal to unity, the microstate probability density 
which in the new variables {x',p') corresponds to the probability density (46), is obtained by a 
simple introduction of (74) and (75): 

/'(x',p',t) = ^exp|-yd3r^(r,f) [/i'(r)-;u(r,f)n'(r)]| . (76) 

Because they are given by the integrals over the phase space, the information entropy S{{t) in 
(49) and the corresponding partition function (45) are invariant to the transformation (74) for 
which the Jacobian of the transformation is equal to unity. With new coordinates {x' ,p') explicitly 
indicated, the information entropy S{{t) is given by the expression 

S{{t) = \ogZt + J (fr(3{r,t)[{h'{r))t-p,{r,t){n'{r))t] , (77) 

while the partition function is given by the expression 

log Zt = log dr'exp - J d^r/3{r,t) [h'{r) - p{r,t)n'{r)] | . (78) 

By averaging the left side of (75) over the microstate probability density given by (46) and averaging 
the right side over the corresponding density (76), and then using (56), one obtains the following 
equalities 

(n'(r))i = (n(r))t 

(P'(r))i = 0 

{h'{r))t = {h{r))t-^mu‘^{r,t){n'{r))t . (79) 
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The last of equations (79) is nothing but an expression for the internal energy density U (r, t). Using 
the transformation (74), and by assuming that the available part of phase space, the invariant set 
M of all possible microstates, is invariant also on the transformation (74), it is shown that the 
partition function (78), probability density (76) and the information entropy (77) do not depend 
on the fluid velocity u(r,t). The time dependence in the expression for the information entropy 
(77) appears only through the quantities (3{r,t) and ^(r,t), in an explicit and implicit way. For 
that reasons, the time derivatives of the information entropy (77) also do not depend on u(r, t). 

r 

Due to the invariance of the information entropy Sj{t) on the transformation (74), the same must 
be true also for the corresponding expressions (49), (52) and (53). This means that, to simplify 
the calculations, everywhere in the expressions (49), (50), (52) and (53) we can safely take that 


u(r, t) = 0. 

When this is done in (53), using the expressions for the Lagrange mnltipliers (50) and the 
current densities (55), or directly in (72), one obtains the corresponding expression for the time 
derivative of information entropy Sj{t). By multiplying it with the Boltzmann constant k and 
with the inclusion of /3{r,t) = (/cT(r, t))“^ we then obtain 


dSjt) 

dt 


= - V 

Jv 


jQ(r,t) 

T{r,t) 


+ / d-^rV 
Jv 


Tir,t) 


jQ(rT) • 


(80) 


Equation (80) can also be recognized as the equation from the thermodynamics of irreversible 
processes that gives the rate of change of entropy of the system. The divergence integral in (80) 
is the change due to entropy exchange through the boundary of the volume of the whole system, 
and accordingly, the sign in front of that term is negative. With regard to the initial assumption 
that the number of particles in the system is fixed, there is no exchange of particles with the 
environment; the given system is closed. Particles can not leave the volume of the system, so the 
fluid velocity vanishes at the bonndary of the volume of the system; therefore, entropy can not pass 
throngh this boundary by the streaming of the fluid. It is easy to see why the divergence integral 
in (80) does not contain the contribution from the convective entropy flow present in (72); the 
convective entropy flow, if it is present within the closed system does not change the total entropy 
of the system, so its total contribution to the rate of entropy change is zero. Furthermore, we can 
also consider the limiting case in which the volume of the system is infinite. Then, also there is 
no exchange of heat with the environment, so the divergence integral in (80) vanishes completely; 
that is the limit in which the system is isolated. 

The second integral in (80) is the volume integral of the quantity known in the thermodynam¬ 
ics of irreversible processes as the density of entropy production, or alternatively, entropy source 
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strength. One of the fundamental postulates of thermodynamics of irreversible processes [23, 24] is 
that this quantity always has the canonical form 

a = (81) 

i 

This canonical form defines the thermodynamic fluxes Jj and the conjugate thermodynamic forces 
Xj denoted by the index i. The comparison of (81) with the second integral in (80) indicates that 
it is possible, by following this fundamental postulate, to define the density of entropy production 
for the classical fluid of identical particles considered here, in the form 

cj(r,t) = V • jQ(r,t) . (82) 

Proper identifications of the thermodynamic forces and fluxes are easily noticeable. From the 
comparison of the volume integrals of the density of entropy production given in (72) and in (80), 
it follows that for a closed system, 

[ (fr{-T)~^daUfiUo,g = 0 , (83) 

Jv 

where the Einstein summation convention for the components of the tensor daUg and the vis¬ 
cous pressure tensor Tiap is again implied. The entropy balance equation (80) is valid also for a 
small volume comoving with the fluid with the local fluid velocity u(r, t). Therefore, the entropy 
production density is given only by (82), and this means that locally 

{-T)~^daUpU.ap = 0 . (84) 

It is clear from the above arguments that (84) follows essentially from the requirement of local 
invariance of the entropy production density to the Galilean transformations, which is the standard 
requirement known from the literature [24]. 

V. CLOSED SYSTEMS WITH EXTERNAL FORCING 

The results in the previous Section were obtained in the setting applicable to the class of closed 
systems that are described by the Hamiltonian function that does not depend on time. This is 
applicable for systems that can exchange energy in the form of heat but can not exchange work and 
particles with the environment. The classical fluid of N identical particles which is described by 
the Hamiltonian function (4) is such a system. Further generalization to systems with Hamiltonian 
function that depends on time is straightforward. It was already explained in Sections HI B, IV 
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and V of the previous paper [2] and in Section IV of this paper. For example, if the Hamiltonian 
function (4) also includes an additional term about which we have prior information, that describes 
the external time dependent potential field <I>e(r, t), 

AT r 2 1 ^ 1 TV 

i=l [ j=l, j^i J i=l 

then (85) describes the classical fluid of N identical particles with the time dependent external 
force Fe(r,t) = — V<I>e(r,t) applied on it. This force may include also the effect of the walls of 
container confining the system of N particles, if it can be described in such a way. Since the 
external potential <he(r,t) has spatial and time dependence, for such a system of N particles the 
total momentum and energy are not conserved and the local macroscopic conservation laws (18) 
must be modified to include the effect of the external force Fe(r,t): 

= ({n(r),i7})* = -V.(J(r)), , 

a(Pa(r))t ^ {{P^{r),H})t =-V ■ {3p^{r))t +{n{r))tFe, a{r,t) , 

= -V • {3hir))t + {n{r))tu{r,t) ■ Fe(r,t) . (86) 

Here (n(r))iFe(r, t) is the external force times the local particle-number density, i.e. the external 
force density. The right hand sides of (86) including the external force terms are obtained from 
the Poisson brackets of the local dynamical variables n(r), P(r) and h{r) with the time dependent 
Hamiltonian function (85), averaged over the microstate probability density f{x,p, t). Therefore, as 
shown in Sections H and IV, if the conditional probability density D{x,p,t\{xo,po)ui,to) is replaced 
by the conditional probability density B{x,p,t\xo,po,to), path probability density F{{xo,po)i^,to) 
with the microstate probability density f{xo,po,to), M and So{M) replaced by T, and dSo replaced 
by dr, as is appropriate in the case of time dependent Hamiltonian function F[{x,p, t), then with all 
these replacements the constraints (32) are equivalent to (86). Accordingly, as explained in Section 
IV, the same replacements are also done in the constraints (26) and (27), and the conditional 
information entropy is replaced by the conditional information entropy 

With all these replacements, and by applying the analogous maximization procedure to 
as was applied to in Section IV, we obtain the MaxEnt conditional prob¬ 

ability density B{x,p,t\xo,po,to), which is analogous and of the same form as (44) obtained for 
D{x,p,t\{xo,po)uj,to) in Section IV. The only difference is with respect to the expressions for the 
time derivative of information entropy Sj{t) in (52) and (53). Using (52), (53) and (86) it is easy 
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to see that the time derivative of information entropy Sj{t) is given here by 

3 

V • (A„(J)i) + V • (A,(J,)i) + V • {XpAJpJt) 

q :=1 



+ 


V(A„) • (J )t + V(AO • {Jh)t + ^ V(ApJ • {Jpjt 


a=l 


/ 


+ / d-^r 


Xh{n)tu • 


' ^ ^Pa a 

a=l 


( 87 ) 


The last line in (87) is the contribution from the external force terms present in (86). With the 
assumption of local equilibrium used here as in Section IV, all local thermodynamic identities 
used in Sec. IV are valid also here. The only difference is that along with the chemical part 
the local chemical potential /u(r, t) now also includes the external potential, i.e. /u(r, t) = 
^c(r,i) + ^e(r,t)- Using the identification of Lagrange multipliers (50) and by following the same 
procedure as in Section IV, from (87) here we also obtain the expression (72) for the time derivative 

r 

of information entropy Sj{t). Furthermore, in analogous way as in Section IV, we also obtain 
relations (80), (82), (83) and (84). Further generalization to open systems is also straightforward 
and along with the derivation of the transport coefficients for the classical fluid it will be the subject 
of the further paper. 


VI. CONCLUSION 

The construction of the probability distribution using the principle of maximum information 
entropy, i.e. by maximizing the information entropy subject to given constraints, includes in 
the probability distribution only the information which is represented by these constraints. The 
predictions derived from such probability distribution are the best predictions possible on the basis 
of available information, without the introduction of additional, uncertain assumptions. If control 
over certain macroscopic quantities reproduces some macroscopic phenomena in the experiment, 
then in accordance with the foundational principle of macroscopic reproducibility, the information 
about the values of these quantities is relevant for prediction of that macroscopic phenomena. 
Therefore, it can be said that consideration of the relevance of available information about the 
system for prediction and reproducibility of the macroscopic time evolution, is essential for a 
better understanding of the appearance of irreversibility. 

On the example of closed Hamiltonian system, it is shown that elementary description of irre¬ 
versible macroscopic time evolution can be given, if the relevant information for nonequilibrium 
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system on the chosen time scale is included in the probability distribution, by introducing it with the 
corresponding additional constraints on the maximization of the conditional information entropy. 
In this way, in the generalized approach developed in this paper, by introducing the hydrodynamic 
continuity equations as the relevant information on the hydrodynamic time scale, the rate of en¬ 
tropy change and the density of entropy production are obtained for the classical fluid of identical 
particles. The obtained expressions are in accordance with the definitions that these quantities 
have in the thermodynamics of irreversible processes. Therefore, as it is shown in this paper, even 
if our information about the microscopic dynamics is incomplete, the hydrodynamic continuity 
equations are, within the framework of predictive statistical mechanics developed in this paper, 
still sufficient for the description of irreversible macroscopic time evolution on the hydrodynamic 
time scale. It is also interesting in this context, as the group of authors have demonstrated [29, 30], 
that applying the principle of maximum information entropy under certain simple constraints can 
reproduce the laws of mechanics. If we consider that the predictive statistical mechanics is a gen¬ 
eral form of inference from available information without additional assumptions, based on the 
maximum information entropy principle and macroscopic reproducibility, the results obtained here 
suggest the importance of its basic principles for the theory of irreversibility. 
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